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ABSTRACT.  A  comprehensive  theory  of  stochastic  realization  for 
multivariate  stationary  Gaussian  processes  is  presented.  It  is 
coordinate- free  in  nature,  starting  out  with  an  abstract  state 
space  theory  in  Hilbert  space,  based  on  the  concept  of  splitting 
subspace.  These  results  are  then  carried  over  to  the  spectral  do¬ 
main  and  described  in  terms  of  Hardy  functions.  Each  state  space 
is  uniquely  characterized  by  its  structural  function,  an  inner 
function  which  contains  all  the  systems  theoretical  characteristics 
of  the  corresponding  realizations.  Finally  coordinates  are  intro¬ 
duced  and  concrete  differential -equation-type  representations  are 
obtained.  This  paper  is  an  abridged  version  of  a  forthcoming 
paper,  which  in  turn  summarizes  and  considerably  extends  results 
which  have  previously  been  presented  in  a  series  of  preliminary 
conference  papers.  — 

/ 

1.  INTRODUCTION  / 


In  recent  years  there  has  been  a  considerable  interest  in  var¬ 
ious  versions  of  the  so-called  stochastic  realization  problem 
[1-51],  which,  loosely  speaking,  can  be  described  as  the  problem 
of  finding  (a  suitable  class  of)  stochastic  dynamical  systems, 
called  realizations,  all  having  a  given  random  process  (y{t);  tcT} 
as  its  output.  (Here  T  is  the  index  set,  which  usually  is  the  real 
line  R  or  the  set  Z  of  integers.)  In  the  past  it  has  often  been 
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assumed  that  y  is  a  stationary  (or  stationary  increment)  process 
with  rational  spectral  density,  thus  insuring  the  existence  of 
finite  dimensional  realizations. 

The  early  papers  on  the  subject  [1-5]  consider  a  deterministic 
version  of  the  problem,  the  objective  being  to  realize  (in  the  de¬ 
terministic  sense  [32,33])  the  spectral  factors  of  the  given  pro¬ 
cess  which  is  defined  up  to  second-order  properties  only.  The 
probabil istic  aspects  of  the  stochastic  realization  problem  were 
subsequently  clarified  in  [8-10].  In  all  these  papers  the  states 
of  the  realizations  are  represented  in  a  fixed  coordinate  system  to 
avoid  trivial  questions  of  uniqueness. 

However,  the  most  natural  approach  to  the  stochastic  realiza¬ 
tion  problem  is  coordinate  free:  Begin  by  constructing  families 
{Xt;  t  e  T)  of  state  spaces  which  evolve  in  time  in  a  Markovian 
manner.  These  state  spaces  should  be  as  small  as  possible,  but 
large  enough  to  contain  the  essential  information  for  determining 
the  temporal  evolution  of  the  given  process.  Then,  for  each  such 
family,  concrete  realizations  can  be  obtained  by  introducing  suit¬ 
able  bases  in  the  state  spaces.  This  line  of  study  was  initiated 
in  [4-6],  where  a  restricted  version  of  the  problem  of  this  paper 
was  studied,  considering  only  state  spaces  contained  in  the  closed 
span  of  the  past  (or,  symmetrically,  the  future)  of  the  given  pro¬ 
cess.  Kith  such  a  state  space  approach  we  need  not  restrict  the 
analysis  to  processes  with  rational  spectral  density,  since  the 
framework  will  also  accommodate  infinite  dimensional  state  spaces. 

During  the  last  couple  of  years  we  have  been  developing  a  state 
space  theory  of  stochastic  realization  which  is  now  in  a  reasonably 
complete  form.  Part  of  our  work  has  been  reported  in  a  series  of 
preliminary  conference  papers  [11-15];  a  more  complete  account  will 
appear  in  a  forthcoming  paper  [26],  which  is  now  under  preparation. 
Some  results  in  the  first  phase  of  this  work  were  obtained  in  co¬ 
operation  with  Ruckebusch  [17],  who  parallelly  developed  his  own 
geometric  state  space  theory  [20,21].  The  present  paper  is  an  at¬ 
tempt  to  summarize  the  results  presented  in  [16].  Due  to  page 
limitations,  not  all  topics  of  [16]  will  be  discussed.  Also  we 
have  left  out  the  proofs  of  the  theorems,  instead  providing  the 
reader  with  references  for  the  proofs.  For  simplicity,  only  reali¬ 
zations  of  continuous-time  stationary  processes  will  be  discussed, 
but  it  should  be  understood  that  our  basic  geometric  theory  holds 
also  for  stationary  increment  processes  and  discrete-time  processes, 
and  that  the  subsequent  spectral  theory  can  be  appropriately  modi¬ 
fied  to  take  care  of  these  cases  also. 
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2.  PROBLEM  FORMULATION 

Let  {y(t);  t  e  R}  be  a  real  stationary  m-dimensional  Gaussian 
process  which  is  purely  nondeterministic,  mean-square  continuous 
and  centered,  and  let  H  be  the  Gaussian  space  [34]  generated  by  y, 
i.e.  the  linear  span  of  the  stochastic  variables  (y^t);  t  e  R, 
k  =  l,2,...,m)  closed  in  I2  norm.  The  space  H  is  a  Hilbert  space 
when  endowed  with  the  inner  product  (£,n)  =  E{£h)>  where  E{*}  stands 
for  mathematical  expectation.  For  any  two  subspaces  A  and  B  of  H 
(which  are  always  taken  to  be  closed),  A  v  B  denotes  the  closed 
linear  hull  of  A  and  B,  EA  denotes  the  orthogonal  projection  on  A, 
and  EAB  signifies  the  closure  of  EAB.  Moreover,  let  A1  denote  the 
orthogonal  complement  of  A  in  H,  and  let  A  ©  B  be  the  orthogonal 
complement  of  B  in  A,  implicitly  implying  that  A  is  a  subspace  of 
B.  Since  y  is  a  stationary  process,  there  is  strongly  continuous 
group  {Ut;  t  c  R}  of  unitary  operators  H  H  such  that  y^t)  * 
Utyk(0)  for  all  t  and  k  *  l,2,...,m  [35] .  In  the  sequel  we  shall 
also  consider  the  two  semigroups  {Ut;  t  a  0}  and  (Ut;  t  a  0}  ob¬ 
tained  by  setting  Ut  :=  Ut  and  Ut  :=  for  t  a  0. 

The  first  problem  at  hand  is  to  determine  families  (Xt;  t c  R} 
of  subspaces  of  H,  such  that 

ykU)  e  Xt  ;  k  =  1,2,. ...m  (2.1) 

for  all  t,  which  are  Markovian  in  the  sense  that 

Extx  »  eX*X  for  all  X  e  X*  (2.2) 

where  X^  : *  VT^tXT  and  Xt  :«VT2tXT,  and  which  are  stationary ,  i.e 
satisfy  the  condition 

Xt  *  UtX0  for  a11  t  e  R  .  (2.3) 

The  subspaces  (Xt)  will  be  called  state  spaces.  This  is  a  gener¬ 
alization  of  the  following  more  concrete  problem:  Find  a  vector- 
valued  stationary  Markov  process  (x(t);  t  c  R}  and  a  matrix  C  so 
that  y (t )  =  Cx(t)  for  all  t  €  R.  However,  as  we  shall  see  in  Sec¬ 
tion  9,  (in  a  strict  sense)  the  latter  problem  generally  makes 
sense  only  if  the  spectral  density  of  y  is  rational,  in  which  case 
there  are  finite  dimensional  Markov  processes  x.  To  circumvent 
this  difficulty  we  would  have  to  consider  weak  Hilbert  space-valued 
Markov  processes.  Problem  formulation  (2.1) -(2.3),  on  the  other 
hand,  is  coordinate  free  and  makes  sense  without  further  restric¬ 
tions  or  modifications. 

In  view  of  condition  (2.3),  it  is  enough  to  require  that 
(2.1)  and  (2.2)  hold  for  one  t,  say  t  =  0;  then  they  will  automati¬ 
cally  hold  for  all  t  e  R.  For  simplicity  we  shall  drop  the  index 
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and  write  X  instead  of  Xq.  Now  define  the  past  space  H"  and  the 
future  space  H*  as  the  closed  linear  hulls  in  H  of  the  stochastic 
variables  (y^t);  t<0,  k  =  1,2,. . .  ,m}  and  {yj^t);  t  2  0, 
k  =  1,2,..., in}  respectively.  Then,  it  follows  from  (2.1)  that 
H'_v  X  c  X"  and  that  H*  c  X+.  Consequently  applying  the  projection 
gH  vx  to  (2.2)  with  t  =  0  we  obtain 

EH  VXX  =  EXX  for  all  X  e  H+  .  (2.4a) 

It  is  easy  to  show  [15]  that  the  symmetric  condition 

EH+VXX  =  EXX  for  all  X  £  H“  (2.4b) 

is  equivalent  to  (2.4a).  A  subspace  satisfying  one  of  conditions 
(2.4)  is  called  a  splitting  subspace.  Loosely  speaking,  such  a 
subspace  contains  all  information  about  the  past  needed  in  predict¬ 
ing  the  future,  or,  equivalently,  all  the  information  about  the 
future  required  to  estimate  the  past. 

PROPOSITION  2.1.  [14] .  Let  X  be  a  subspace  of  H  and  let 
S  :=  H"  v  X  and  S  :=  H+  v  X.  Then  the  family  {UtX;  t  e  R)  satis¬ 
fies  conditions  (2.1)  and  (2.2)  if  and  only  if  X  is  a  splitting 


sub  space  such  that 

UtS  c  S 

for  all  t  2  0 

(2.5a) 

and 

ut5  c  S 

for  all  t  2  0  . 

(2.5b) 

In  view  of  this  proposition  we  shall  say  that  a  splitting  sub¬ 
space  is  Markovian  if  it  satisfies  conditions  (2.5).  Hence  we  can 
instead  consider  the  problem  of  finding  Markovian  splitting  sub¬ 
spaces.  This  problem  formulation  has  the  advantage  of  also  cover¬ 
ing  situations  which  are  not  discussed  in  this  paper,  e.g.  realiza¬ 
tion  of  processes  with  stationary  increments  and  discrete-time 
processes,  for  which  problem  formulation  (2.1)-(2.3)  is  too  restric¬ 
tive  (since  it  does  not  allow  for  observation  noise,  for  example). 
Hence  the  basic  geometric  theory  developed  below  has  a  wider  appli¬ 
cability,  as  we  shall  demonstrate  in  some  subsequent  papers. 

Obviously  the  whole  space  H  is  a  Markovian  splitting  subspace, 
and  so  are  H‘  and  H+,  but  they  are  too  large  for  our  purposes. 
Indeed,  the  whole  idea  is  to  obtain  "data  reduction."  Therefore 
we  shall  be  particularly  interested  in  (Markovian)  splitting  sub¬ 
spaces  X  which  are  minimal  in  the  sense  that  there  is  no  proper 
subspace  of  X  which  is  also  a  (Markovian)  splitting  subspace.  The 
following  proposition  implies  that  a  minimal  Markovian  splitting  sub 
space  is  the  same  thing  as  a  Markovian  minimal  splitting  subspace. 
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PROPOSITION  2.2.  [16].  Any  minimal  Markovian  splitting  sub  space  is 
a  minimal  splitting  subspace. 

When  the  Markovian  splitting  subspaces  have  been  adquately 
characterized,  there  remains  the  problem  of  obtaining  concrete  dy¬ 
namical  representations  of  the  given  process  y  based  on  these  state 
spaces,  if  possible  of  differential  equation  type.  Note  that  we 
are  only  considering  representations  for  which  the  state  spaces  are 
contained  in  the  Hilbert  space  H  generated  by  the  given  process  (or 
its  increments),  i.e.  internal  realizations.  Our  theory  could  be 
modified  to  accommodate  realizations  containing  exogeneous  random 
elements  ( external  realizations),  but  this  is  outside  the  scope  of 
this  paper,  being  a  bit  unnatural  in  the  present  setting. 


3.  THE  GEOMETRY  OF  SPLITTING  SUBSPACES 

Our  first  problem  will  be  to  determine  the  set  of  all  splitting 
subspaces,  and,  in  particular,  those  which  are  minimal. 

The  predictor  space 

X.  :=  EH  H+  (3.1) 

is_a  splitting  subspace.  To  see  this,  note  that,  for  all  X  e  H+, 

Eh  X  e  X_;  hence  EH~X  =  EX-EH~A  =  Ex-A.  Moreover,  all  splitting 
subspaces  X  c  H"  contain  X_.  In  fact,  by  (2.4a),  E^  H+  =  EXH+  which 
is  contained  in  X.  Hence  X_  is  a  minimal  splitting  subspace.  By 
symmetry,  we  see  that  the  backward  prediction  space 

X+  :=  EHV  (3.2) 

is  also  a  minimal  splitting  subspace.  (The  reader  is  urged  to  care¬ 
fully  distinguish  between  X_  and  X+  and  X-  and  X+  defined  in  Sec¬ 
tion  2.  The  reason  for  the  former  notation  will  be  clear  from  what 
follows. ) 

PROPOSITION  3.1.  [14].  The  spaces  H,  H"  and  H+  have  the  orthogonal 
decompositions 

H  =  N-  •  H°  9  N+  ,  (3.3a) 

H*  =  N-  9  X.  and  H+  =  N+  •  X*  ,  (3.3b) 

where  H°  :«  X.  v  x+,  N~  :=  H ’  n  (H+)i  and  N*  :=  H+  n  (H")A. 

The  space  H°  is  called  the  frame  space  and  N'  and  N*  are 
called  the  (past  respectively  the  future)  junk  spaces.  These  nota¬ 
tions  are  suggested  by  the  following  result. 


«•« 
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PROPOSITION  3.2.  [14].  Let  Ik  be  a  minimal  splitting  eubspaae. 

Then 

H*  n  H+  c  X  c  H°  .  (3.4) 


Hence  the  frame  space  H°  is  the  closed  linear  hull  of  all  min¬ 
imal  splitting  subspaces,  and  consequently  it  contains  all  "infor¬ 
mation"  needed  for  state  space  construction.  On  the  other  hand, 
the  junk  spaces  contain  no  useful  information  and  could  be  dis¬ 
carded.  It  is  not  hard  to  see  that  the  frame  space  is  itself  a 
(generally  nonminimal)  splitting  subspace.  The  following  proposi¬ 
tion  illustrates  the  importance  of  these  concepts  in  filtering 
theory.  It  should  be  compared  with  the  corresponding  result  in 
[20] ,  which  is  weaker. 

PROPOSITION  3.3.  [16].  Let  X  be  a  splitting  subspaae.  Then 


U- 

E  X  =  X 


(3.5a) 


if  and  only  if  X  l  N-,  and  symmetrically 

EH+X  =  X+  (3.5b) 

if  and  only  if  X  l  N+. 

We  shall  say  that  the  given  process  y  is  nonoyclic  if  it  has 
nontrivial  junk  spaces,  i.e.  N"  *  0  and  N+  *  0,  and  strictly  non - 
cyclic  if  N"  and  N+  are  both  full  range.  (A  subspace  A  c  H  is 
full  range  if  the  closed  linear  hull  of  {UtA;  t  e  R)  in  H  is  all 
of  H. )  In  the  scalar  case  (m  =  1)  strict  noncyclicity  is  the  same 
as  noncyclicity.  Clearly  the  problem  of  state  space  construction 
is  not  very  interesting  unless  we  have  noncyclicity,  since  other¬ 
wise  there  will  be  no  "data  reduction,"  H"  and  H*  being  minimal 
splitting  subspaces. 

In  order  to  describe  the  set  of  splitting  subspaces,  we  need 
to  introduce  the  concept  of  perpendicular  intersection.  Two  sub¬ 
spaces  of  H,  A  and  B,  are  said  to  intersect  perpendicularly  if 

EAB  =  A  n  B  (3.6a) 

or  equivalently  [15] 

EBA  =  A  (i  B  .  (3.6b) 


If  A  and  B  together  span  all  of  H,  we  have  the  following  character 
ization  of  perpendicular  intersection. 
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PROPOSITION  3.4.  [15].  Let  A  and  B  be  subspaces  of  H  such  that 
A  v  b  *  H.  Then  A  and  B  intersect  perpendicularly  if  and  only  if 
B1  c  A  or,  equivalently ,  k1  c  B. 

•L 

Now,  if  H“  and  H*  intersect  perpendicularly,  H°  =  H"  n  H+, 
and  consequently  there  is  a  unique  minimal  splitting  subspace, 
namely  H'  n  H+  (Proposition  3.2).  Hence  the  problem  of  finding  the 
minimal  splitting  subspaces  is  trivial.  In  general,  however,  H" 
and  H+  do  not  intersect  perpendicularly,  but,  by  appropriately  ex¬ 
tending  H*  and  H*  so  that  the  extended  spaces  intersect  perpendicu¬ 
larly,  we  can  still  describe  each  splitting  subspace  as  the  inter¬ 
section  between  two  sub  spaces. 

THEOREM  3.1.  [15).  The  subspace  X  <=  H  is  a  splitting  subspace  if 
and  only  if 

X  =  S  n  5  (3.7) 

for  some  perpendicularly  intersecting  subspaces  S  and  S  such  that 
S  =  H"  and  5  3  H*.  The  correspondence  X  ■*-*•  (S,5)  is  one-one,  the 
pair  (S,5)  being  uniquely  determined  by  relatione 

S  *  H-  v  x  (3.8a) 


and 


5  *  H*  v  X  . 


(3.8b) 


COROLLARY  3.1.  A  subspace  X  c  H  is  a  splitting  subspace  if  and 
only  if  there  are  subspaces  S  3  H"  and  5  3  H+  such  that  one  of  the 
following  four  equivalent  conditions  hold 


X  =  ESS  (3.9a) 
X  =  ESS  (3.9b) 
X  *  S  0  51  (3.9c) 
X  =  S  e  S1  .  (3.9d) 


A  subspace  S  such  that  S  =  H"  (S  =  H+)  will  be  called  an  aug¬ 
mented  past  (future)  space.  Hence,  each  (minimal  or  nonminimal) 
splitting  subspace  is  uniquely  characterized  by  two  perpendicularly 
intersecting  subspaces  S  and  5,  one  being  an  augmented  past  space 


For  a  process  y  with  rational  spectral  density  4>,  H"  and  H+  inter¬ 
sect  perpendicularly  if  and  only  if  ♦  has  no  zeros,  i.e.  y  is  a 
"purely  autoregressive"  process. 
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and  one  an  augmented  future  space.  We  shall  write  X  ~  (S,S)  to  re¬ 
call  this  correspondence.  For  example,  X_  ~  (S_,§_)  where  S_  * 

H"  v  x  =  H"  and  S_  =  H+  v  X_  =  (N-)1  (Proposition  3.1).  Likewise, 
X+  ~  (S+,S+)  where  S+  =  (N+) ^  and  5+  =  H+. 

To  have  X  minimal  we  clearly  need  to  make  S  and  5  as  small  as 
possible.  Given  an  S,  the  smallest  5  which  both  contains  H+  and 
intersects  S  perpendicularly  is 

§  =  H+  v  S1  (3.10a) 

(Proposition  3.4).  Likewise,  given  S, 

S  =  H”  v  S'1  (3.10b) 

is  the  smallest  sub space  containing  H'  which  intersects  5  perpendi¬ 
cularly.  It  is  not  hard  to  see  that  the  two  conditions  not  only 
characterize  minimality  but  also  the  splitting  property. 

THEOREM  3.2.  [IS].  Let  S  a  H"  and  5  =>  H+  be  two  subspaces,  and 
set  X  =  S  n  S.  Then  X  is  a  minimal  splitting  subspace  if  and  only 
if  both  conditions  (3.10)  hold. 

In  view  of  Proposition  3.2,  (3.3a)  and  (3.8),  it  is  clearly 
necessary  that 

S  c  (N*)1  (3.11a) 

and  that 

S  c  (NT)1  (3.11b) 

in  order  that  X  ~  (S,S)  be  minimal,  but  not  sufficient;  in  fact, 

any  subspace  of  H°  satisfies  (3.11).  However,  in  Theorem  3.2., 
conditions  (3.10)  can  be  replaced  by  (3.10a)  +  (3.11a)  or  by 
(3.10b)  +  (3.11b),  as  seen  from  the  following  pair  of  propositions. 

PROPOSITION  3.5.  [14].  Let  S  =>  H"  and  5  =>  H+  be  two  subspaces  sat¬ 
isfying  (3.10a).  Then  (3.10b)  holds  if  and  only  if  (3.11a)  holds. 

PROPOSITION  3.6.  [14].  Let  S  =  H"  and  S  =  H+  be  two  subspaces  sat¬ 
isfying  (3.10b).  Then  (3.10a)  holds  if  and  only  if  (3.11b)  holds . 

It  follows  from  Theorem  3.2  and  Proposition  3.5  that  X  is  a 
minimal  splitting  subspace  if  and  only  if  S  :=  H+  v  X  is  given  by 
(3.10a)  and  S  :=  H~  v  x  satisfies 

H*  c  S  c  (N+)X  ,  (3.12) 

in  which  case  X  =  £%*■,  as  can  be  seen  from  (3.9a)  and  (3.10a). 
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Consequently  the  minimal  splitting  subspaces  are  in  one-one  corre¬ 
spondence  with  subspaces  S  satisfying  (3.12).  For  this  reason, 
we  shall  call  a  subspace  satisfying  (3.12)  a  minimal  augmented  past 
space.  The  set  of  such  subspaces  form  a  complete  lattice,  where 
the  partial  ordering  is  induced  by  the  c  operation.  Consequently 
the  set  of  minimal  splitting  subspaces  also  form  a  complete  lat¬ 
tice,  in  which  X_  is  the  minimum  element  and  X+  is  the  maximum.  In 
fact,  as  we  have  seen  above,  S_  =  H"  and  S+  =  (N+)1. 

Symmetrically,  there  is  a  one-one  correspondence  between  the 
minimal  splitting  subspaces  and  subspaces  §  such  that 

H+  c  §  c  (N*)1  .  (3.13) 

We  shall  call  such  a  sub space  a  minimal  augmented  future  space. 

In  terms  of  it,  the  minimal  splitting  subspace  has  the  representa¬ 
tion  X  =  EsH‘. 


4.  OBSERVABILITY,  CONSTRUCTIBILITY  AND  MINIMALITY 

Relation  (2.4a),  defining  a  splitting  subspace  X  ~  (S,5),  can 
be  written 


ES|h+  »  ES| x  -  EX|h+  ,  (4.1a) 

where  |A  denotes  restriction  to  the  domain  A.  (Here  the  first  op¬ 
erator  on  the  right-hand  side  is  merely  an  insertion  map,  insuring 
that  the  range  spaces  match.)  Likewise,  the  alternative  definition 
(2.4b)  can  be  written 


Define  G+  :=  ES|H+  and  G"  :=  I h~ *  T^en  t*ie  splitting  property 

(2.4)  is  equivalent  to  either  of  the  two  Hankel  operators  G+  and  G" 
having  a  factorization  through  X  described  by  the  commutative  dia¬ 
grams 


respectively,  where  0  :=  Ex|^+,  C  :=  Ex ] ,  R  =  Es|v  and  R.=  ES|X. 
Such  a  factorization  is  said  to  be  canon-teal  [32]  if  the  first 
factor  (here  R  or  ft)  is  one-one  and  the  second  factor  (here  0  or  C) 
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maps  onto  a  dense  subset  of  X;  if  the  second  factor  maps  onto  X  we 
say  that  the  factorisation  is  exactly  canonical. 

Since  the  insertion  map  R  is  trivially  one-one,  the  first  of 
diagrams  (4.2)  is  canonical  if  and  only  if 

EXH+  =  X  .  (4.2  .) 

A  splitting  subspace  with  this  property  is  said  to  be  observable; 
the  mapping  0  is  called  the  observability  operator.  Likewise,  the 
second  factorization  (4.2)  is  canonical  if  and  only  if 

EXH"  =  X  .  (4.3b) 

If  this  condition  holds,  we  say  that  X  is  cons  true tible;  we  call  C 
the  cons  true tibility  operator  [20].  If  one  of  the  factorizations 
is  exactly  canonical,  the  closure  bar  over  the  E  in  the  correspond- 
ind  relation  (4.3)  can  be  removed;  then  we  say  that  X  is  exactly 
observable  (E^H+  =  X)  or  exactly  construatible  (E*H“  =  X)  respec¬ 
tively. 

It  follows  from  (3.9a)  and  the  splitting  property  (2.4a)  that 
a  splitting  sub  space  X  is  observable  if  and  only  if 

ESS  =  ESH+  .  (4.4) 

But  this  condition  is  equivalent  to 

5  =  H+  v  sx  .  (4.5) 

In  fact,  since  E^A  =  0  for  A  e  S1,  it  is  easy  to  see  that  (4.5)  im¬ 
plies  (4.4).  To  see  that  (4.5)  is  a  consequence  of  (4.4),  first 
note. that,  since  S  and  S  intersect  perpendicularly  (Theorem  3.1), 

5  =  H+  v  S1  (Proposition  3.4).  But  Z  :=  §  ©  (H+  v  Sx)  c  S  n  (H+)x,  and 
therefore  (4.4)  cannot  hold  unless  Z  =  0.  In  the  same  way  we  see 
that  a  splitting  subspace  X  is  constructive  if  and  only  if 

S  =  H'  v  51  ,  (4.6) 

and  hence  we  have  proven  the  following  theorem. 

THEOREM  4.1.  Let  X  ~  (S,S)  be  a  splitting  subspace.  Then  X  is  ob¬ 
servable  if  and  only  if  (4.S)  holds  and  construatible  if  and  only 
if  (4.6)  holds. 

We  can  now  tie  together  the  concepts  of  observability  and  con- 
structibility  with  that  of  minimality,  discussed  in  Section  3.  It 
follows  from  Theorems  3.2  and  4.1  that  a  splitting  subspace  is 
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minimal  if  and  only  if  it  is  both  observable  and  con struct ibl e. 

This  point  can  also  be  illustrated  in  the  following  way:  Apply  the 
projector  E^  to  (2.4a)  to  obtain  E^'X  =  E^'E^X  for  all  X  e  H+, 
i.e.  the  diagram 


commutes  if  X  is  a  splitting  subspace,  where  C*  =  E^  is  the  ad¬ 
joint  of  the  constructibility  operator  C  =  EX | .  It  is  not  hard 
to  see  that  C*  is  one -one  if  and  only  if  C  maps  onto  a  dense  sub¬ 
set  of  X.  (Cf.  [36;  p.89].)  Consequently,  in  view  of  the  equiva¬ 
lence  between  minimality  and  observability  plus  constructibility 
proven  above,  the  factorization  (4.7)  is  canonical  if  and  only  if 
X  is  minimal.  Of  course,  in  the  same  way,  if  X  is  a  splitting  sub¬ 
space,  the  dual  diagram 


commutes,  and  it  is  canonical  if  and  only  if  X  is  minimal. 

Finally  we  summarize  the  connections  between  observability, 
constructibility  and  minimality  provided  by  Theorems  5.2  and  4.1 
and  Propositions  3.S  and  3.6. 

THEOREM  4.2.  Let  X  ~  (S,S)  be  a  splitting  subspace.  Then  the  fol¬ 
lowing  conditions  are  equivalent: 

(i)  X  is  minimal 


(ii)  X  is  observable  and  constructive 

(iii)  X  is  observable  and  S  is  minimal 

(iv)  X  is  constructible  and  §  is  minimal. 
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5.  MARKOVIAN  SPLITTING  SUBSPACES 

Let  X  ~  (S,S)  be  a  splitting  subspace.  Then,  by  Proposition 
2.1,  X  is  Markovian  if  and  only  if  the  two  conditions 

US  c  S  (left  invariance)  (5.1a) 

and 

U^S  c  §  (right  invariance)  (5.1b) 

both  hold.  It  is  immediately  seen  that  X_  ~  (H'.fN')1)  and 
X+  ~  ((N+)J‘,H+)  satisfy  these  conditions,  and  consequently  X_  and 
X+  are  Markovian  splitting  sub  spaces.  Hence  all  minimal  Markovian 
splitting  subspaces  form  a  complete  sublattice  of  the  lattice  de¬ 
fined  in  Section  3,  with  X_  being  the  minimum  and  X+  the  maximum 
element. 

If  (5.1a)  holds,  {0t|g;  t  >  0}  is  a  strongly  continuous  semi¬ 
group  on  S,  and  the  same  holds  true  for  the  ad joints 

Ut(S)  :=  ESUtls  ;  t  >  0  (5.2a) 

Similarly,  if  (5.1b)  holds,  t  a  0}  and  the  adjoints 

0t(S)  :=  ES0t | g  ;  t  a  0  (5.2b) 

both  form  strongly  continuous  semigroups  on  5.  Operators  of  type 
(5.2)  are  called  compressions  of  the  shifts  Ut  and  Ut  respectively. 
Compressions  with  respect  to  subspaces  other  than  S  and  5  will  be 
denoted  analogously.  It  can  be  shown  that  a  Markovian  splitting 
subspace  X  ~  (S,S)  is  invariant  for  Ut(S)  and  0t(§).  More  pre¬ 
cisely  we  have: 

PROPOSITION  5.1.  [16].  Let  X  ~  (S,S)  be  a  splitting  subspace. 

Then  the  conditions  (5.1a)  and 

0t(5)X  c  X  (5.3a) 

are  equivalent.  Similarly  (5.1b)  is  equivalent  to 

U  (S)X  C  X  .  (5.3b) 

Conditions  (5.3)  imply  that  for  each  £  €  X,  Ut(S)£  =  Ut(X)£ 
and  Ut(§)£  =  Ut(X)£,  where  Ut(X)  and  Ut(X)  are  defined  as  in  (5.2). 
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The  operators  Ut(X)  :  X  -*■  X  and  Ut(X)  :  X  -*•  X  will  play  a  very  im¬ 
portant  role  in  what  follows. 

THEOREM  5.1.  [16].  The  splitting  subspace  X  is  Markovian  if  and 
only  if  (Ut(X);  t  k  0}  [{Dt(X);  t  2  0}]  is  a  strongly  continuous 
semigroup. 

Hence,  we  shall  call  (Ut(X);  t  a  0}  the  forward  Markov  semi¬ 
group  and  {Ut(X);  t  a  0}  the  backward  Markov  semigroup  of  the  Mar¬ 
kovian  splitting  subspace  X.  The  following  theorem  describes  how 
these  shift  operators  intertwine  the  Hankel,  observability  and  con- 
structibility  operators  introduced  in  Section  4. 

THEOREM  5.2.  [16].  Let  X  ~  (S,§)  be  a  Markovian  splitting  subspace. 
Then  the  following  diagrams  commute. 


G+  G- 


(For  simplicity  we  write  Ut  and  0t  in  place  of  Ut  |  and  °tlH" 
respectively. ) 

As  a  corollary  of  this  theorem,  we  obtain  the  factorization 
G+Ut  =  RUt(X)0  (5.4a) 

and  its  backward  counterpart 

G-0t  =  ROt(X)C  ,  (5.4b) 

which  should  be  compared  with  the  corresponding  factorizations  in 
deterministic  realization  theory  [32].  Relations  (5.4)  will  be 
used  in  Section  9. 

A  Markovian  splitting  subspace  X  ~  (S,§)  is  said  to  be  proper 
if  both  S  and  S  are  purely  nondeterministic.  [A  subspace  Z  is 
purely  nondeterministic  ifnt£^UtZ  =  0.]  If  X  is  proper,  neither  S 
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nor  §  has  a  doubly  invariant  subspace,  i.e.  a  subspace  which  satis¬ 
fies  both  conditions  (5.1),  and,  moreover,  X  is  a  proper  subspace 
of  both  S  and  S.  In  fact,  if  X  =  S  (say),  (3.7)  implies  that 
S  :  §,  and  hence  we  must  have  5  =  H,  which  contradicts  the  purely 
nondeterministic  assumption.  Consequently  properness  of  X  insures 
effective  data  reduction. 

PROPOSITION  5.2.  [14].  Let  y  be  strictly  nonayclia.  Then  all 
splitting  subspaces  X  c  H°  (i.e.,  in  particular,  the  minimal  ones) 
are  proper. 

Any  proper  splitting  subspace  is  also  purely  nondeterministic 
[but  the  opposite  is  not  true;  H"  ~  (H',H)  could  serve  as  a  counter¬ 
example],  and  therefore  the  following  result  can  b  ’iplied. 

PROPOSITION  5.3.  [16].  Let  X  be  a  purely  nondeterministic  splitting 
subspace.  Then  Ut(X)  and  Ut(X)  tend  strongly  to  zero  as  t  -*•  ®. 

6.  SPECTRAL  REPRESENTATION  OF  PROPER  MARKOVIAN  SPLITTING 
SUBSPACES 

Since  the  given  process  y  is  stationary,  mean-square  continu¬ 
ous  and  purely  nondeterministic,  it  has  a  spectral  representation 

y(t)  =  |  estd?(s)  ,  (6.1) 

where  integration  is  over  the  imaginary  axis  I  and  d?  is  an  orthog¬ 
onal  stochastic  vector  measure  such  that 

E{d5>(iw)dy(  iu>)  *}  =  4>(iw)du)  ,  (6.2) 

4>  being  the  mxm  matrix-valued  spectral  density  of  y  [35].  (Aster¬ 
isk  (*)  here  denotes  conjugation  plus  transpose.)  Moreover,  y 
being  purely  nondeterministic  implies  that  $>  has  a  constant  rank 
p  <  m  and  that  it  admits  a  factorization  [35;  p.114]. 

A  full-rank  spectral  factor  is  any  mxp-matrix  solution  of 

W(s)W(-s)  =  <fr(s)  (6.3) 

such  that  rank  W  =  p.  To  any  such  spectral  factor  we  may  associate 
a  p-dimensional  Wiener  process  on  R 

u(t)  =  J  6  du(s)  ;  dG  =  W'Ldy  ,  (6.4) 

where  E{du(iw)du(iii))*}  =  Idui,  and  W-^  is  a  left  inverse  of  W. 
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Despite  the  fact  that,  in  general,  K  has  more  than  one  left  in¬ 
verse,  it  can  be  shown  [16]  that  du,  and  hence  u,  is  uniquely  de¬ 
fined.  Let  U  denote  the  class  of  all  such  Wiener  processes,  and 
let  H(du),  H'(du)  and  H+(du)  be  defined  as  the  closed  linear  hulls 
in  H  of  (uj<(t);  t  e  T,  k  =  l,2,...,p},  where  T  is  R,  {t  s  0}  and 
{t  s  0}  respectively.  As  these  notations  suggest,  we  are  merely 
interested  in  the  increments  of  the  processes  u  e  U,  the  assumption 
u(0)  =  0,  contained  in  (6.4),  being  for  convenience  only. 

It  can  be  shown  [14]  that  each  u  e  U  spans  all  of  H,  i.e. 

H(du)  =  H.  Consequently  our  basic  Hilbert  space  H  consists  pre¬ 
cisely  of  the  random  variables 


n 


f (-t)du(t)  , 


(6.5a) 


where  f  varies  over  the  space  L^(R)  of  p-dimensional  row-vector 
functions  square-integrable  on  the  real  line  (with  respect  to  the 
Lebesgue  measure).  This  representation  can  be  transformed  to  the 
spectral  domain  to  read 


n  =  j  f (iui)du(iii))  ,  (6.5b) 

where  w  -*  f(iui)  is  the  Fourier- transform  of  f,  defined  in  the  L2 
sense.  To  conform  with  formulations  prevalent  in  the  systems 
sciences,  formally  we  use  the  double-sided  Laplace- transform,  f  be¬ 
longing  to  the  space  L^(I,  ~  dw)  of  p-dimensional  row-vector  func¬ 
tions  which  are  square-integrable  on  the  imaginary  axis  I;  we  shall 
write  L^(I)  for  shorty  Also,  we  shall  adopt  the  convention  of 
writing  Ff  to  denote  ?.  Then  F  is  a  unitary  operator  from  L?(R) 
to  L§( I). 


For  each  u  e  U,  (6.5b)  defines  an  isomorphism  between  H  and 
L?(I).  Let  Qy  :  H  -  Lj(I)  be  the  mapping 


%  s 

n  '“*•  f  •  (6.6) 


Then  it  follows  from  the  definition  of  stochastic  integral  that 
is  a  unitary  operator.  As  is  evident  from  (6.5a),  H"(du)  consists 
precisely  of  those  n  for  which  f  c  L?(0,®),  i.e.  for  which  f  van¬ 
ishes  on  the  negative  real  line.  Likewise,  H+(du)  consists  of  those 
p  for  which  f  e  LE(-«  0).  Then,  defining  the  Hardy  spaces  Ho  := 
FL?(0,»)  and  Ho  :=  FJLc(-»,0),  we  clearly  have  Q  H‘(du)  *  Ho  and 
<yi*(du)  ■=  Hj. 

The  functions  in  H^  can  be  extended  to  the  right  complex  half¬ 
plane  and  can  be  seen  to  be  analytic  there  [37-40].  Likewise,  the 
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H^-functions,  properly  extended,  are  analytic  in  the  open  left  half- 
plane.  Therefore  we  shall  say  that  a  full -rank  spectral  factor  is 
stable  if  all  its  rows  belong  to  H*  and  strictly  unstable  if  its 
rows  belong  to  Ho.  Let  li+  and  IT  Ee  the  subclasses  of  U  correspond¬ 
ing  to  stable  and  strictly  unstable  spectral  factors  respectively. 

LEMMA  6.1.  [14].  There  is  a  one-one  correspondence  between  stable 
full-rank  spectral  factors  Vi  (determined  modulo  multiplication  with 
a  constant  unitary  matrix)  and  left  invariant  [i. e. ,  satisfying 
(5.1a)]  and  purely  nondeterministic  subspaces  S  =  H".  The  subspace 
S  is  related  to  Vi  by 

S  =  H'(du)  (6.7) 

where  u  e  U+  is  the  Wiener  process  corresponding  to  W. 

LEMMA  6.2.  [14].  There  is  a  one-one correspondence  between  strictly 
unstable  full-rank  spectral  factors  Vi  and  right  invariant  [i.e.j 
satisfying  (5.1b)]  and  purely _nondeterminis tic  subspaces  §  =  H  . 

The  subspace  3  is  related  to  Vi  by 

S  =  H+(du)  (6.8) 

where  u  e  U~  is  the  Wiener  process  corresponding  to  W. 

Since  y  is  a  purely  nondeterministic  process,  H"  and  H+  are 
purely  nondeterministic  subspaces,  and  therefore  the  lemmas  above 
apply.  Hence  there  is  u_  e  il+  such  that 

H"(duJ  =  H"  .  (6.9) 

This  is  the  innovation  process  of  y.  Let  W_  be  the  corresponding 
spectral  factor.  In  view  of  (6.1)  and  the  fact  that  dy  =  W_du_, 
Qu_ay(t)  =  e^ultaW_  for  all  t  c  R.  But  Qu_H"  =  and  therefore 
sp-{eia)taiv_  |  t  s  0,  a  e  Rm)  =  H where  sp{*}  denotes  closed  span 
in  H.  A  function  W  with  this  property  is  called  outer  [37-40]; 

W_  is  the  unique  outer  spectral  factor.  Likewise,  there  is  a 
u+  e  U~  such  that 

H+(du+)  =  H+  ,  (6.10) 

called  the  backward  innovation  process  of  y.  The  corresponding 
spectral  factor  W+  has  the  outer  property  with  t  s  0  and  H 2  ex¬ 
changed  for  t  a  0  and  H^.  Such  a  function  is  called  conjugate 
outer ;  is  the  only  spectral  factor  with  this  property. 

By  Lemmas  6.1  and  6.2  there  is  a  one-one  correspondence_between 
proper  Markovian  splitting  subspaces  X  ~  (S,S).  and  pairs  (W,W)  of 
full-rank  spectral  factors  with  W  stable  and  W  strictly  unstable 
or,  equivalently,  pairs  (u,u)  of  Wiener  processes  with  u  e  U*  and 
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u  €  U~ .  We  shall  call  W(W)  the  forward  (backward)  spectral  factor 
of  X  and  u(u)  the  forward  (backward)  generating  process  of  X.  For 
each  such  pair  (K,W),  we  define  a  pxp  matrix  function 

K  =  rLW  ,  (6.11) 

which  we  call  the  structural  function  of  X.  Although  the  left  in¬ 
verse  W-^  is  nonunique,  it  can  be  shown  [16]  that  K  is  uniquely 
defined.  In  fact, 

du  =  Kdu  .  (6.12) 

The  structural  function  K  will  play  a  very  important  part  in  what 
follows.  Due  to  certain  similarities  with  the  Lax-Phillips  scat¬ 
tering  operator  [41],  we  shall  alternatively  call  if  the  scattering 
function.  It  is  not  hard  to  see  that  K(ia>)  is  a  unitary  matrix  for 
each  u)  £  R.  Next,  we  shall  show  that,  in  addition,  K  is  bounded 
and  analytic  in  the  open  right  half-plane.  A  function  with  all 
these  properties  is  called  inner  [37-40]. 

Now,  in  view  of  Theorem  3.1  and  Lemmas  6.1  and  6.2,  X  is  a 
proper  Markovian  splitting  subspace  if  and  only  if 

X  =  H" (du)  n  H+ ( du)  (6.13) 

for  some  u  e  U+  and  u  e  U~  such  that  H'(du)  and  H+(du)  intersect 
perpendicularly.  As  pointed  out  above,  the  pair  (u,u)  is  unique, 
being  the  pair  of  generating  processes  of  X. 

LEMMA  6.3.  [14].  Let  u  e  U+  and  u  e  U~ ,  and  let  W  and  W  be  the 
corresponding  spectral  factors.  Then  S  :=  H~(du)  and  §  :*  H+(du) 
intersect  perpendicularly  if  and  only  if  K,  defined  by  (6.12),  is 
inner. 

The  proof  of  this  lemma,  which  can  be  found  in  [14],  is  based 
on  the  vector  version  of  Beurling's  Theorem  [37-40]. 

By  Corollary  3.1,  (6.13)  can  be  written  X  =  H"(du)  ©  H~(du), 
the  isomorphic  image  of  which  (under  Qy)  is  QyX  =  ©  (f^K).  Con¬ 

sequent!  y 

X  =  (H^K) Adu  ,  (6.14) 

where  u  e  U+  is  the  Wiener  process  corresponding  to  W,  and  the 
superscript  l  denotes  orthogonal  complement  in  H 2*  We  collect  these 
observations  in  the  following  theorem.  Representation  (6.14)  should 
be  compared  with  the  deterministic  solutions  of  [48,49]. 


THEOREM  6.1.  [1S,16].  The  subspace  X  is  a  proper  Markovian _split- 
ting  subspace  if  and  only  if  (6.14)  holds  for  somejpair  (N,K)  of 
full  rank  spectral  factors  such  that  K  is  stable,  N  is  strictly 
unstable ,  and  K  :*  K_LH’  is  inner. 

In  particular,  if  y  is  strictly  noncyclic,  all  minimal  Marko¬ 
vian  splitting  subspaces  are  given  by  Theorem  6.1  (Proposition  5.2). 
The  minimum  and  maximum  lattice  elements  X_  and  X*  correspond  to 
the  pairs  (K_,K_)  and  (W^.W^),  where  W_  and  K+  are  the  outer  and 
conjugate  outer  spectral  factors  defined  above.  The  corresponding 
pairs  of  generating  processes  are  (u_,0_)  and  (u+,u+).  The  pro¬ 
cesses  u.  and  u+  are  the  forward  and  backward  innovation  processes 
respectively,  and  u_  and  u+  can  be  defined  in  terms  of  the  junk 
spaces  through  the  relations  H"(du_)  =  N’  and  H+(du+)  =  N+.  The 
following  result,  which  is  a  generalization  to  the  vector  case  of 
a  result  found  in  [58],  provides  a  test  for  noncyclicity  in  terms 
of  the  outer  and  conjugate  outer  spectral  factoT. 

PROPOSITION  6.1.  [14].  The  process  y  is  strictly  noncyclic  if  and 
only  if  there  are  inner  functions  Jj,  J2j  J3  cmd  J4  such  that 

w;LW_  *  jjj"1  *  J"\l4  .  (6.15) 

In  the  scalar  case  (m  =  l),  the  structural  function  K  is  in¬ 
variant  over  the  set  of  (proper)  minimal  Markovian  splitting  sub¬ 
spaces,  but  this  is  not  so  in  the  vector  case.  This  point  can  be 
illustrated  by  a  finite  dimensional  example:  The  Kronecker  struc¬ 
ture  of  a  concrete  differential -equation  representation  (of  the 
type  derived  in  Section  9)  is  uniquely  determined  by  K,  but  this 
structure  varies  with  different  minimal  X  [16]. 

PROPOSITION  6.2.  [14].  Let  X  be  a  proper  Markovian  splitting  sub- 
space.  Then  X  is  finite  dimensional  if  and  only  if  its  structural 
function  K  is  rational. 

This  proposition  has  two  interesting  corollaries. 

COROLLARY  6.1.  [15].  Suppose  that  the  spectral  density  4>  is  ra¬ 
tional.  Then  all  splitting  subspaces  X  contained  in  the  frame 
space  Ha  are  finite  dimensional ,  and  all  minimal  splitting  subspaces 
have  the  same  dimension. 

COROLLARY  6.2.  [15].  Suppose  that  $  is  rational.  Then  y  is 
strictly  noncyclic. 

For  further  discussion  of  the  rational  case  we  refer  the 
reader  to  Section  7  in  [15],  where  differential -equations  represen¬ 
tations  are  derived  by  factorization  of  the  structural  function  K, 
using  the  ideas  of  [4  2]. 
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7.  SPECTRAL  DOMAIN  CRITERIA  FOR  OBSERVABILITY 
CONSTRUCTIBILITY  AND  MINIMALITY 

Theorem  6.1  provides  us  with  a  procedure  to  find  all  proper 
Markovian  splitting  subspaces:  All  possible  pairs  (K,W)  of  full- 
rank  spectral  factors  with  W  stable,  W  strictly  unstable,  and  K  * 
K'^K  inner,  inserted  into  (6.14),  generate  the  whole  family  of  such 
splitting  subspaces.  But  how  can  we  decide  whether  such  a  pair  will 
provide  an  observable,  or  a  constructible  or  a  minimal  splitting 
subspace?  We  need  to  translate  the  geometric  criteria  of  Section  4 
into  spectral  domain  language. 

To  this  end,  first  note  that  W  is  a  stable  full -rank  spectral 
factor  if  and  only  if  it  can  be  written 

K  =  K_Q  (7.1) 

where  Q  is  an  inner  function  and  W_  is  the  unique  outer  spectral 
factor.  Similarly,  W  is  a  strictly  unstable  full -rank  spectral 
factor  if  and  only  if  it  has  the  representation 

W  =  W+Q  ,  (7.2) 

where  Q  is  conjugate  inner  (i.e.  Q*  is  inner)  and  W+  is  the  unique 
conjugate  outer  spectral  factor  [37-40].  The  observability  condi¬ 
tion  (4.5)  and  the  constructibility  condition  (4.6)  can  now  be  ex¬ 
pressed  in  terms  of  the  inner  functions  K,  Q  and  Q*. 

THEOREM  7.1.  [15].  Let  X  be  a  proper  Markovian  splitting  subspace3 

let  (7,1)  and  (7.2)  be  the  corresponding  spectral  factors ,  and  let 
K  be  the  structural  function  (6,11).  Then  X  is  observable  if  and 
only  if  K  and  Q*  are  left  coprime  and  constructible  if  and  only  if 
K  and  Q  are  right  coprime. 

Two  inner  functions  are  left  (right)  coprime  if  they  have  no 
common  left  (right)  inner  factor,  except  possibly  for  a  constant 
unitary  matrix.  Hence,  by  Theorem  7.1,  X  is  observable  if  and  only 
if  there  is  no  nontrivial  cancellation  in  the  factorization  T  *  (Jk. 
But  according  to  [43,44]  (also  see  [39]),  this  is  the  case  if  and 
only  if 

cl  (ImRj.)  =  (H^K)1  ,  (7.3) 

where  Hj  :  ■*  is  the  Hankel  operator  Hyf^=  P  2fr  and  ImHj  de¬ 

notes  the  range  of  Hj,  cl  the  closure,  and  P^2  the  orthogonal  pro¬ 
jection  on  H 2 .  In  tne  same  way,  X  is  constructible  if  and  only  if 

there  are  no  nontrivial  cancellations  in  T  =  QK*,  which  statement 
is  equivalent  to 


_  r 
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cKlmHjr)  =  , 


(7.4) 


where  H*f  :  ■*  Ht  is  the  Hankel  operator  Hyf  =  Pn2fr  and  jl  now  de¬ 

notes  orthogonal  complement  in  Hj. 


To  clarify  the  nature  of  conditions  (7.3)  and  (7.4),  we  shall 
take  a  closer  look  at  the  Hankel  operators  Hj  and  Bf,  along  the 
lines  of  [14].  To  this  end,  first  note  that  Hj  and  Hj  are  related 
to  the  Hankel  operators  G *  and  G'  through  the  commutative  diagrams 


H+ 


V 

Qu 

V 

1 

,  ht 

r 

Hr 

1  i 

Qq 


H- 


*2 


(7.5) 


Then  it  follows  from  (4.2)  that  Bp  and  Hf  factor  according  to  the 
commutative  diagrams 


where  X  :=  QyX,  X  :=  QqX, 
insertion  maps  ftf  =  f  and 


Rf  =  f. 


(7.6) 


P^fT,  and  R  and  I  are  the 


Since  R  is  merely  an  insertion,  ImHy  *  ImO,  and  therefore 
(7.3)  is  precisely  the  observability  condition  (4 .3a),  transformed 
as  in  (7.5),  for,  by  Theorem  6.1,  X  *  (H^K)-1.  Likewise  it  is  seen 
that  (7.4)  is  the  same  as  the  construction ity  condition  (4.3b). 


However,  [43,44]  also  contain  the  stronger  result  that  (7.3) 
holds  with  the  closure  operation  removed  if  and  only  if  K  and  Q* 
are  strongly  left  coprime,  i.e.  infRe^sw0{  |aK(s)  |  |a(J*(s)|)  >  0 

for  every  a  e  R.  The  analogous  statement  holds  for  (7.4)  and  K 
and  Q.  Hence  we  have  the  following  strong  version  of  Theorem  7.1. 

THEOREM  7.2.  Lei  X,  K,  Q  and  be  as  in  Theorem  7.2.  Then  X  is 
exactly  observable  if  and  only  if  K  and  are  strongly  left  co¬ 
prime  and  exactly  cons  true tible  if  and  only  if  K  and  Q  are  strongly 
right  coprime. 
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In  order  to  apply  conditions  (iii)  and  (iv)  of  Theorem  4.2, 
we  also  need  to  characterize  minimality  of  S  and  5  in  the  spectral 
domain.  We  shall  say  that  a  stable  (strictly  unstable)  full -rank 
spectral  factor  is  minimal  if  it  corresponds  to  a  minimal  augmented 
past  (future)  space  via  the  correspondence  of  Lemma  6.1  (Lemma  6.2). 
Now,  assume  that  y  is  strictly  noncyclic.  Then  the  spectral  fac¬ 
tors  W+  and  W_  introduced  in  Section  6  are  well-defined.  Let  Q+ 
and  Q_  be  the  inner  factors  in  (7.1)  and  (7.2)  respectively  cor¬ 
responding  to  these  spectral  factors.  Moreover,  let  K_  and  K+  be 
the  structural  functions  of  X_  and  X+. 

THEOREM  7.3.  [14].  Suppose  y  is  strictly  noncyclic .  Let  W  be  a 
stable  full-rank  spectral  factor ,  and  let  J  :  =  W"^W+.  Then ,  J  is 
uniquely  defined ,  and  the  following  conditions  are  equivalent: 

(i)  W  is  minimal 

(ii)  Q  is  a  left  inner  divisor  of  Q+>  i.e.  there  is  an  inner 
function  6  such  that  Q0  *  Q+ 

(iii)  J  is  inner. 

If  one  of  these  conditions  holds ,  J  and  K+  are  right  aoprime. 

The  fact  that  (i)  and  (ii)  are  equivalent  was  first  proven  in 
[19]  for  the  scalar  case.  The  dual  version  of  Theorem  7.3  goes  as 
follows. 

THEOREM  7.4.  [14].  Suppose  y  is  strictly  noncyclic.  _Let  W  be_a 
strictly  unstable  full-rank  spectral  factor,  and  let  J  :* 

Then,  J  is  uniquely  defined,  and  the  following  conditions  are 
equivalent: 

(i)  W  is  minimal 

(ii)  is  a  right  inner  divisor  of  Q* 

(iii)  J*  is  inner. 

If  one  of  these  conditions  holds,  1*  and  K_  are  left  coprime. 

Note  that  the  coprimeness  conditions  of  Theorems  7.3  and  7.4 
are  related  to  T  and  T  as  follows:  T  *  K+J*  and  T  *  K.J*.  This 
has  some  significance  for  state  space  isomorphism  [16]. 


22 


8.  ABSTRACT  REALIZATION  THEORY  IN  HARDY  SPACE 

We  shall  now  translate  the  results  of  Section  5  to  the  spec¬ 
tral  domain,  thereby  laying  the  ground  work  for  concrete  differen¬ 
tial-equation  type  representations  to  be  introduced  in  the  next 
section. 

In  view  of  (6.1),  any  n  £  H  can  be  written 


n  = 


(8.1) 


for  some  f  e  (“(IjMa)).^  Define  the  unitary  operator  Qy  : 

H  ■+  Lfd.MoO  by  QyP  *  f,  and  introduce  the  spaces  V +  :=  QyH+  and 
y~  :=  QVH*,  which  consist  of  all  linear  functionals  of  theruture 
and  past_respectively  of  y.  Then  V*  -  spTae1**1*  j  a  e  Rm;  t  a  0} 
and  r=  sp{aeiwt  |  a  e  Rm;  t  £  0).  .Clearly,  for  t  a  0,  /+(k")  is  in¬ 
variant  under  multiplication  by  elwt (e'i^^) .  For  each  t  a  0,  let 
Lf  :  V*  -*■  and  :  V  -*  V~  be  the  mappings  Z^f  =  e^l)tf  and 
Itf  =  e_1U)tf  respectively.  Now,  for  any  proper  Markovian  splitting 
subspace  X  ~  (S,S),  let  the  operators  G+  and  G'  be  defined  in  terms 
of  the  Hankel  operators  G+  and  G"  by  the  commutative  diagrams 


G+ 

H+ - »s 


-*s 


Qy 


G+ 

Qu  ^y 

* 

T  G  ^ 

v* - *h%  y 

'• - >H 

Qu 


(8.2) 


Then  G+f  =  P  2fW  and  G'f  =  P  2fW,  i.e.  G+  and  G~  are  the  Hankel 
operators  corresponding  to  the  input-output  maps  f  -*■  fW  and  f  ►+■  fW 
respectively. 


For  any  t  a  0  and  subspace  Z  <=  iS(I),  define  the  compressions 
Zt(Z)  :=  P^e-*-1^^- 1 2  and  T^(Z)  P^e- ^  1 £,  where  we  are  slightly  mis¬ 
using  notations  by, letting  eluJt  also  denote  multiplication  by 
the  function  u  e^t.  Then,  setting  X  :=  QyX  and  X  :=  QqX,  it  is 
immediately  clear  that  QuUt(X)Q{ji  =  Zt(X)  and  QaU*(X)Q51  *  ITt(£) 
and  that  Zt(H|)  and  rt(H2)  are  analogously  related  to  Ut(S)  and 
Ut(5)  respectively.  Note  that  (Zt(X);  t  a  0}  and  {rt(X);  t  a  0} 
are  strongly  continuous  semigroups  (Theorem  5.1)  which  tend  strongly 
to  zero  as  t  +  “(Proposition  5.3).  We  shall  call  them  the  forward  and 
the  backward  spectral  semigroups  of  X;  X  and  X  will  be  called  the 
forward  and  backward  spectral  images  of  X  respectively.  Then,  by 
isomorphism,  the  following  proposition  is  a  corollary  of  Theorem  5.2. 


PROPOSITION  8.1.  Let  X  be  a  proper  Markovian  splitting  subspace 
with  generating  processes  (u,u)  and  spectral  images  X  :=  QyX  and 
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X  :=  QqX.  Then  the  diagrams 


commute ,  where  Of  =  P^fW,  Cf  =  P-^fW  and  R  and  R  are  the  insertion 
maps  Rf  =  f  and  JTf  =  f. 

By  isomorphism,  X  is  observable  if_and  only  cl{Im6}  =  X  and 
constructible  if  and  only  if  cl{lmC}  =  X.  Clearly,  since  aW  e  X 
for  all  a  e  Rm  (this  is  equivalent  to  ay(0)  e  X,  as  can  be  seen  by 
inserting  dy  =  Wdu  into  (6.1)),  Oe^^a  =  £t(X)M^.a  for  t  2  0,  where 
MW  =  f  *  is  the  mapping  Mya  =  aK.  Then,  since  V*  = 
ip^ae^  |  a  e_Rm;  t  2  0}  ,  clUroO)  =  cKUtaoIm^CX)!^]} .  Likewise, 
noting  that  aW  e  X  for  all  a  e  Rm,  cl{imc}  =  cl{Ut^Im[rt(X’)Mjj-] } , 
where  :  Rm  ■*  X  is  defined  as  the  mapping  M^a  =  aW-  Hence  we 
have  proven 

PROPOSITION  8.2.  Let  X  be  a  proper  Markovian  splitting  subspace 
with  spectral  images  X  and  X.  Then  X  is  observable  if  and  only  if 

cl{Ut^0Im[Zt(X)Mw]}  =  X  (8.3) 

and  constructible  if  and  only  if 

cl{Ut20lm[rt(^)Mjf]}  *  *  •  C8.4) 

Condition  (8.3)  is  precisely  the  observability  condition  of  a 
(deterministic)  dynamical  system  with  semigroup  {E~(X)*;  t  2  0}  and 
read-out  map  ( observation  operator')  M$  :  X  -*■  Rm  [45;  p.211],  and 
this  is  precisely  the  role  these  operators  will  play  in  the  differ¬ 
ential-equation  type  representations  of  Section  9.  Likewise,  (8.4) 
is  the  observability  condition  of  a  system  with  semigroup 
{Ft(X);  t  2  0}  and  observation  operation  MjJ-  :  X  ■*  Rm.  Since  any 
linear  operator  A  from  one  Hilbert  space  V  to  another  Z  satisfies 
the  condition 


cl{ImA}  9  ker  A*  =  Z 


(8.5) 


we  may  alternatively  write  the  observability  condition  (8.3)  as 
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nt>0  ker[MjZt(x)*]  =  0  (8.6) 

and  the  constructibility  condition  (8.4) 

At>0  ker[M±.rt(*)*]  =  0  ,  (8.7) 

where  ker  B  is  the  null  space  (kernel)  of  B. 

It  follows  from  (6.12)  that  the  relationship  between  the  for¬ 
ward  and  the  backward  spectral  image  of  X  is  given  by 

X  =  JTk  ,  (8.8) 

where  K  is  the  structural  function  of  X.  Let  :  3T  X  be  the 
mapping  f  ►+  fK.  Then  Mjr  is  a  unitary  operator.  The  following 
proposition  described  the  interplay  between  forward  and  backward. 

PROPOSITION  8.3.  [16].  Let  X  be  a  proper  Markovian  splitting  sub- 
spaae.  Then  the  relations  between  its  forward  and  backward  spec¬ 
tral  semigroups  and  its  forward  and  backward  observation  operators 
is  given  by  the  commutative  diagram 


COROLLARY  8.1.  The  constructibility  condition  (8.4)  can  be  written 
cl{Ut20Im[Zt(X)*Mw]}  =  X  (8.9) 

or  equivalently 

nt>o  kerKztW3  =  0  •  (8*10) 

In  the  sequel  we  shall  express  all  relations  only  in  its  for¬ 
ward  form,  referring  the  reader  to  Proposition  8.3  for  a  recipe 
to  obtain  the  backward  counterpart. 

This  theory  also  provides  us  with  a  natural  factorization  of 
the  autocorrelation  function  of  y. 

PROPOSITION  8.4.  [16],  The  mum  matrix  function  A(t)  :  =  E{y(t)y(0) '} 
has  the  factorizations 
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A(t) 


M^Et(X)*Mh.  for  t  >  0 
MjE^CX)^,  for  t  <  0  . 


(8.11) 


Since  Mjf  and  Et(X)*  are  bounded  operators,  they  can  be  repre¬ 
sented  by  matrices.  Let  (x^  ,X2, . . .  ,5^}  be  an  arbitrary  basis  in 
X,  where,  in  general,  n  =  ».  (Such  a  basis  exists,  since  X  is 
separable.)  Then  Et(X)x^  =  £ja^j(t)Xj  for  some  numbers  {a^j(t)}. 
Since  Et(X)  is  a  strongly  continuous  semigroup,  it  has  a  represen¬ 
tation  Et(X)  *  eAt,  where  A  is  the  infinitesimal  generator 
[39,41,45].  Therefore  we  shall  write  e^£  to  denote  the  nxn-matrix 
{cxi j  (t)}  ;  i.e. 


E„(X)x.  =  7  (eFt) . -x. 

t'-  ^  i  t  \  j 


j  =  l 


1J  3 


(8.12) 


Note  that,  unless  n  <  F  should  not  be  interpreted  as  a  matrix, 
since,  in  general,  A  is  not  a  bounded  operator  defined  everywhere 
on  X.  Similarly,  if  ( ©i , • • • > em)  is  the  canonical  (orthonormal) 
basis  in  Rra,  we  define  the  mxn-matrix  H  through  the  relation 


11 

M.,.e .  =  J  H.  .x.  . 
W  i  jti  ^  3 


Applying  the  operator  to  this  relation,  we  obtain 


(8.13) 


n 

>'*(0)  =  I  H.  x  ,  (8.14) 

j_l  J  J 

where  (xj  ,X2>  •  •  •  jXj^}  :=  {Q[]1x1,Q-1X2»  •  •  •  is  a  basis  in  X. 

Relation  (8.14)  illustrates  the  fact  that  H  is  a  matrix  of  the  ob¬ 
servation  operator.  Define  P  to  be  the  nxn  covariance  matrix  with 
components 

PjLj  =  E{xiXj}  .  (8.15) 


Then  it  is  clear  from  (6.5b)  that 


P.  . 


<  xi,xj  >x 


(8.16) 


where  denotes  inner  product  in  the  Hilbert  space  X. 

We  are  now  in  a  position  to  formulate  the  results  of  this 
section  in  matrix  form.  For  t  a  0,  Proposition  8.4  yields 
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But,  combining  (8.12)  and  (8.15),  we  have 


(8.17) 


:,«Vi  -  I  • 

J=1  •  J 


(8.18) 


which  inserted  into  (8.17)  together  with  (8.15)  yields 
A(t)  =  HeFtPH'  for  t  >  0 


(8.19a) 


after  applying  (8.16).  In  the  same  way,  letting  e^'1  denote  the 
transpose  of  e^,  we  have 


A(t)  =  HPe’F,tH'  for  t  <  0  . 


(8.19b) 


To  obtain  matrix  representations  for  the  backward  operators, 
first  note  that  {5^  ,$2>  •  •  •  >^n^ »  where  =  Mj^x^  (i  =  1 ,2, . . .  ,n) , 
is  a  basis  in  X.  By  applying  Mjj*  to  (8.13),  we  see  that  Mjj- has  the 
matrix  H  with  respect  to  this  basis.  However,  for  the  semigroup 
the  situation  is  a  bit  more  complicated.  For  t  s  0,  define  the 
nxn -matrix  e^"t  by 


I  (X)x. 


n  Ft,  « 


-t 


V  r  rL>  - 

i  "  •)ijXj  ’ 


(8.20) 


which,  by  Proposition  8.3,  can  be  written 
n 


MX) 


v  f  -Ft,  ~ 
x.  =  )  (e  ) . .x. 

1  j=i  ^  J 


(8.21) 


for  all  t  >  0.  Then,  taking  (8.16)  into  account,  inserting  (8.12) 
and  (8.21)  in  the  defining  relation 


<xi,Zt(X)x.>  =  <It(X)*x.,x.> 


yields 


Ft  -Ft  -1 

e  =  Pe  P  1  for  t  >  0  , 


(8.22) 


which  should  be  compared  with  the  corresponding  result  in  [8] . 
(Also  see  [46]  for  the  original  wide  sense  result.) 


Finally,  it  is  not  hard  to  see  that  the  observability  criterion 
(8.6)  has  the  matrix  formulation 


0^  ker(He  j  =  0 


(8.25) 


and  that  the  matrix  version  of  the  construct ibility  criterion  (8.7) 
reads 


nts0  ker(HeFt)  =  0  . 


(8.24) 


9.  DYNAMICAL  REPRESENTATIONS  OF  MARKOVIAN  SPLITTING 
SUBSPACES 

At  this  point  the  abstract  realization  problem  has  been  solved. 
All  proper  Markovian  splitting  subspaces  have  been  determined,  and 
the  corresponding  semigroups  and  observation  operators  have  been 
characterized.  The  problem  is  now  to  what  extent  these  abstract 
realizations  can  be  represented  by  stochastic  differential  equations. 

Let  X  be  a  proper  Markovian  splitting  subspace  with  forward 
generating  process  u.  We  shall  say  that  y  admits  a  regular  (for¬ 
ward)  realization  with  respect  to  X  if,  for  some  Hilbert  space  S, 
there  are  a  strongly  continuous  semigroup  (eAt;  t  >  0}  on  S  and  a 
bounded  operator  B  :  Rp  -*■  S  such  that 


x  =  f  I 

k=l 


■“  A0 

<c,e  Be^.>^dUj.(o)  c  e  S 


(9.1) 


where  <•,•>£  denotes  the  inner  product  in  S  and  {ej ,e2» . . . ,ep)  is 
the  canonical  basis  in  RP.  [Of  course,  in  order  that  (9.1)  be 
well-defined,  the  function  t  **■  <c,eAtBejc>  must  belong  to  L 2(0, °°) 
for  all  c  e  S  and  k  =  l,2,...,m,  so  this  is  implicitly  assumed  in 
the  definition.]  Then,  since  yj(0)  e  X  for  each  i  =  l,2,...,m, 
there  are  c^ ,C2> • • • >cm  e  S  such  that 


y^o)  -  I 

k=l 


_  AfT 

<ci,e  Bej.>^dUj.  (o) 


(9.2) 


Define  the  operator  C  :  S  ■+  Rm  in  the  following  way  (since  we  shall 
have  no  further  use  of  the  constructibility  operator,  we  shall  take 
the  liberty  to  give  a  new  meaning  to  C) :  Let  Cf  be  the  m-dimensional 
vector  with  components  <c^,f>$,  i  =  l,2,...,m.  Then  C  is  a  bounded 
operator,  and  (9.2)  can  be  written 
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y(0) 


Ce~A°Bdu(o) 


(9.5) 


We  shall  call  such  a  representation  a  (forward)  regular  realiza¬ 
tion  of  y  with  respect  to  X,  the  word  "regular"  referring  to  the 
boundedness  of  the  operators  e^*,  B  and  C  and  "with  respect  to  X" 
referring  to  property  (9.1).  The  Hilbert  space  S  will  be  called 
the  range  space  of  the  realization,  X  the  state  space.  Applying 
the  group  (Ut;  t  £  R}  of  shift  operators  to  (9.3)  we  obtain 


y(t) 


f  CeA(-t_a)Bdu(o) 


(9.4) 


for  each  t  e  R,  as  can  be  seen  by  a  simple  change  of  variables. 


Formally  we  can  write  (9.4)  as 
x(t)  =  eA^t_a^Bdu(a) 

-CO 

y(t)  =  Cx(t)  , 


(9.5) 


where  the  state  x(t)  takes  values  in  S.  However,  in  doing  so,  we 
shall  have  to  be  careful.  Unless  dim  S  <  <*>,  x(t)  cannot  in  gen¬ 
eral  be  defined  as  a  Hilbert  space-valued  random  variable  in  the 
usual  sense  [45,47],  For  this  to  be  possible  the  covariance  oper 
ator  must  be  nuclear,  and,  as  we  shall  see  below,  this  is  usually 
not  the  case.  However,  (x(t) ;  t  e  R}  can  be  interpreted  as  a  weak 
Markov  process,  by  using  the  theory  for  weak  random  variables  de¬ 
veloped  by  Balakrishnan  [45);  for  a  discussion  of  this,  see  [16]. 
In  any  case,  we  may  formally  write  the  realization  in  the  differ¬ 
ential-equation  form 


dx  =  Axdt  +  Bdu 
y  =  Cx  , 


(9.6) 


to  be  interpreted  either  by  (9.4)  or  (9.5),  the  latter  requiring 
the  theory  of  [45] . 

From  (6.4)  and  (6.5)  we  have 


(° 

y(0)  =  w(-c)du(o)  , 


(9.7) 


where  w  = 


F_1W  is 


the  inverse  Fourier  transform  of  the  spectral 
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factor  W.  Comparing  (9.3)  and  (9.7)  it  is  seen  that,  in  general, 
there  is  no  regular  realization  with  respect  to  an  arbitrary  x, 
since  w  must  be  continuous  for  this  to  be  the  case.  Nevertheless, 
as  we  shall  see  below,  the  regular  realizations  are,  in  a  sense, 
dense  so  that  we  can  always  find  one  that  is  an  arbitrarily  good 
approximation.  Let  us  assume,  for  the  moment,  that  y  does  admit  a 
regular  realization  with  respect  to  X.  Then  we  may  ask  the  question 
whether  any  deterministic  realization  w(t)  =  CeAtB  which  is  regular 
(i.e.  B  and  C  are  bounded  [48,49])  would  do  the  job.  To  answer 
this  question,  note  that,  for  t  5  0, 

ESyi(t)  =  l  <eA  tci,e'A°Bek>sduk(o)  ,  (9.8) 

1  k=lJ  -oo 

where  eA*z  denotes  the  adjoint  of  eAt,  and  that,  by  the  splitting 
property  (2.4),  ESyi(t)  =  EXyj(t).  Therefore,  forming  the  closed 

span  of  (9.8)  over  al  1 l;  s  0  and  i  =  l,2,...,m,  it  is  seen  that 

(9.1)  is  satisfied  if  E^H+  =  X  and  sp{eA  *0^;  t  z  0,  i  =  l,2,...,m}= 
S.  Hence,  if  X  is  observable  and  the  pair  (C,A)  is  observable  in 
the  deterministic  sense  [45],  the  answer  to  our  question  is  "yes." 
For  an  arbitrary  proper  Markovian  splitting  subspace  X,  however, 
things  are  more  complicated.  This  should  b£  expected,  since  in 
general  two  spectral  factors,  namely  W  ancl  W,  are  needed  to  charac¬ 
terize  X,  whereas  in  the  observable  case  W  is  uniquely  determined 
from  IV  via  (4.5).  Also  it  is  reasonable  to  require  that  the  range 
space  is  as  small  as  possible.  This  is  achieved  by  requiring  that 
(A,B)  is  controllable  [45].  Note,  however,  that  the  controllability 
condition  has  nothing  to  do  with  the  splitting  subspace  X,  but  is 
desired  merely  in  order  to  obtain  a  range  space  S  "of  the  same 
size"  as  X. 


In  view  of  the  results  of  Section  8,  this  suggests  that  we 


try  to  use  the  spectral  image  X  of  X  as  a  range  space.  To  this 
end,  we  first  need  to  introduce  the  concept  of  regular  splitting 
subspace.  Let  £  be  the  class  of  all  functions  in  (.^(I)  having  a 
continuous  inverse  Fourier  transform.  (Note  that  l^£l)  n  L 2(1)  is 
a  proper  subset  of  C.)  Then,  in  view  of  (6.5),  X  c  f  if  the  regu¬ 
larity  condition  (9.1)  holds,  and  therefore  the  operator  Vq  : 

X  -*■  RP  given  by  Vgf  =  (F_*f)(0)  is  defined  on  all  of  X.  We  shall 
say  that  X  is  a  regular  splitting  subspace  if  Vq  is  a  bounded  oper¬ 


ator. 


LEMMA  9.1.  [16].  Let  X  be  a  proper  Markovian  splitting  subspaoe 
and  let  X  :%QUX  be  its  spectral  image.  Then  X  is  regular  if  and 
only  if  X  c  C. 

Clearly  all  finite  dimensional  X,  if  there  are  any,  are  regu 
lar.  The  following  lemma  is  a  corollary  of  Proposition  8.1. 
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LEMMA  9.2.  [16] .  Let  C  £  X  and  let  \  :=  F'*£.  Then ,  /or  each 
t  >  0, 

?(t  +  o)  =  (F"12t(X)C)(o)  (9.9) 

/or  almost  all  a  on  [0,«). 

Now,  let  X  be  a  regular  splitting  subspace,  and  let  a  e  Rm. 
Then,  since  aW  e  X  c  C  (Lemma  9.1),  aw(t)  is  continuous  and 
Lemma  9.2  yields 

aw(t)  =  V0It(X)Mwa  .  (9.10) 

[It  can  be  seen  [16]  that  (9.10)  corresponds  to  the  factorization 
(5.4a).]  This  leads  to  the  factorization  described  by  the  commu¬ 
tative  diagram 


(9.11) 


where  Mw^t)  denotes  multipl ication  from  the  right  by  the  matrix 
w(t).  Since  matrix  multiplication  from  the  left  is  the  adjoint  of 
multiplication  by  the  same  matrix  from  the  right, 

w(t)b  =  (VQIt(X)Mw)*b  .  (9.12) 


Now,  It(X)  and  M#  are  bounded  operators,  and  regularity  of  X  in¬ 
sures  that  Vg  is  bounded  also.  Therefore  (9.7)  and  (9.12)  yield 
after  applying  the  shift 


y(t) 


.00 


(9.13) 


This  is  a  regular  realization  with  respect  to  X,  as  is  seen  from 
the  following  theorem. 

THEOREM  9.1.  [16].  The  process  y  has  a  regular  realization  with 
respect  to  X  if  and  only  if  X  is  a  regular  splitting  subspace.  In 
this  case,  the  range  space  can  be  taken  to  be  X  :=  QyX  and  ,  B 
and  C  to  be  Et(X)*,  Vg  and  MjJ  respectively. 


We  shall  call  (9.13)  the  standard  (forward)  realization  corre¬ 
sponding  to  X.  We  have  already  encountered  the  observation  operator 
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MjJ  and  the  Markov  semigroup  £t(X)*  in  Section  8,  where  conditions 
for  observability  and  constructibility  were  given.  It  can  be 
shown  [16]  that  the  standard  realization  is  spectrally  minimal 
[39],  and  that  the  pair  (It(X)*,Vg)  is  exactly  controllable.  The 
covariance  matrix  of  x(0)  is  the  identity  I,  and  therefore  the 
corresponding  representation  (9.5)  must  be  interpreted  in  the  weak 
sense. 

Obviously,  if  y  admits  a  forward  regular  realization  with  re¬ 
spect  to  X,  it  also  admits  a  backward  one.  In  particular,  the 
analysis  above  can  be  carried  out  in  the  backward  setting  also  to 
yield  the  standard  backward  realization 

y(t)  =  j°°  ro_t(3T)*\r*da(a)  (9.14) 


corresponding  to  X.  The  relationship  between  the  operators  in 
(9.13)  and  (9.14)  is  described  by  Proposition  8.3  and 


vo  =  mkvo 


(9.15) 


Also  it  is  not  hard  to  see  that  x(0)  :=  M^xfO)  is  the  state  cor 
responding  to  the  standard  backward  realization. 


However,  an  arbitrary  proper  Markovian  splitting  subspace  will 
in  general  not  be  regular,  since  F-1QUX  may  contain  functions  which 
are  not  continuous  (Lemma  9.1),  and  in  this  case  y  will  have  no 
regular  realization  with  respect  to  X  (Theorem  9.1).  (Note  that 
this  situation  is  unique  to  continuous-time  processes;  in  the  dis¬ 
crete-time  setting  all  X  are  regular,  since  the  evaluation  operator 
Vq  is  always  bounded.)  We  shall  show,  however,  that  in  each  X 
there  is  a  dense  subset  of  random  variables  £  such  that  each  pro¬ 
cess  £(t)  :=  Ut£  admits  a  regular  realization  with  respect  to  a 
sub  space  of  X. 


Our  basic  strategy  will  be  to  convolute  each  function  in 
F^C^jX  by  a  scalar  L 2  function  $.  The  resulting  functions  will  be 
continuous  [50;  p.398]  and  consequently  the  techniques  described 
above  can  be  applied.  Hence  define  the  subspace  X^  =  H  to  be 


\  =  *  (P"1QUX)  ]  .  (9.16) 

Also  let  Ba  :  RF  ■+■  X  be  the  bounded  operator  defined  by  B^b  * 
P*(F<f>_b),  where  X  =  QuX  and  4>_(t)  :=  <p( -t) . 


PROPOSITION  9.1.  [16].  Let  <f»  e  (^t0*00)*  TTj en  X<j,  c  X.  Moreover , 


V 


P  1 0 


5  €  X 


ky_»<c'z-°(x)Vx>xdUk(o) 

where  (e2 >e2> • • • *ep)  the  canonical  basis  in  Rp. 


(9.17) 


Here  (9.17)  should  be  compared  with  (9.1).  Even  if  y  does 
not  admit  a  regular  realization  with  respect  to  X,  it  can  be  approxi¬ 
mated  uniformly  closely  by  another  process  which  has  a  regular  re¬ 
alization  with  respect  to  c  X. 


PROPOSITION  9.2.  [16].  For  any  e  >  0,  there  is  a  0  e  L->(0,°°)  such 
that ,  for  all  t  £  R  and  k  =  1,2, _ ,m. 


II ykCt)  -  yk(t;<f>)||  <  e 


where 


y(t;<[>) 


Kzt -aw*Vu(a)  • 

■OO  ~ 


(9.18) 


Note  that  the  only  difference  between  (9.13)  and  (9.18)  is 
the  B-matrix.  For  the  moment,  let  B  denote  either  Vq  or  B^,  and 
let  {ej  ,<*2, . . .  ,ep}  be  the  canonical  basis  in  Rp,  {e^  ,ei, . . .  .e^ 
being  reserved  for  Rm  as  in  Section  8.  Let  h(t)  :=  My5Et(X)*B. 
Then 


h.j(t)  -  <e.,^t(X)*Be.>Rm 
=  <B*It(X)Mwe.,e.>Rp  . 


(9.19) 


Now,  let  n  be  the  (usually  infinite)  dimension  of  X,  and  let 
{xj,X2«. • . ,xn)  be  the  basis  in  X  introduced  in  Section  8.  Let  eht 
and  H  be  the  matrices  of  It(X)*  and  respectively  as  defined  by 
(8.12)  and  (8.13),  and  let  G  be  the  corresponding  matrix  of  B,  i.e. 

n 

B*x.  =  l  G..e  .  (9.20) 

j=l  J 

Then  it  follows  from  (9.19)  that  h(t)  =  HeptG,  i.e.  (9.13)  or  (9.18) 
has  the  matrix  representation 

y(t)  =  f  HeF(t"0)Bdu(o)  ,  (9.21) 


which,  taking  due  care  to  properly  define  the  possibly  infinite¬ 
dimensional  state,  can  be  written  in  differential-equation  form. 
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